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Abstract 

This study investigates the predictors of school practitioners’ (N = 2,425) use of educa¬ 
tional research. The suggested model explained significantly but modestly the infrequent 
use of educational research by practitioners. Of the four factors in the study, “opinions 
about research” had the most explanatory power. The results are discussed in connec¬ 
tion with existing knowledge about school practitioners’ use of educational research and 
implications for further research and practice. 

Keywords: factor analysis, multiple regression, predictors of use, school practice, use of 
research-based infonnation (RBI) 


Resume 

Cette etude examine les facteurs predictifs de Tutilisation des connaissances issues de la 
recherches educatives par les praticiens scolaires (N= 2425). Le rnodele propose a expli- 
que de facon significative, mais modestement, Tutilisation peu frequente de la recherche 
educative par les praticiens. Des quatre facteurs “opinions sur la recherche” est celui qui 
est le plus correle a Tutilisation des recherches educatives par les praticiens scolaires. Les 
resultats sont analyses en relation avec les connaissances actuelles sur l’usage scolaire de 
la recherche educative par les praticiens. Les implications pour les recherches futures et 
pour la pratique sont egalement explicites. 

Mots-cles: analyse factorielle, facteurs predictifs de Tutilisation, pratiques scolaires, 
regression multiple, utilisation des connaissances issues de la recherches 
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Introduction 

The first decade of the 21st century has been marked by renewed calls for educational 
practice that is based on the results of educational research. In one notable example of 
many such efforts, Hattie (2009) summarized more than 800 research syntheses of educa¬ 
tional research and pointed to effective strategies and techniques for teaching and learn¬ 
ing. Despite considerable efforts of many, the unsystematic use or non-use of educational 
research to inform educational practice continues to deter the progress and success of 
educational ventures (e.g., OECD, 2000, 2007, 2010). 

Much has been written about the issues that account for the disconnect between 
educational research and practice. First, ever-changing and ambiguous goals and expec¬ 
tations with regard to educational standards favour the use of practical wisdom (Lortie, 
1975). Second, the evidence accumulated through decades of educational research largely 
exists in a disassembled state, making it difficult for practitioners’ to access it, to con¬ 
solidate it, and to use it (OECD, 2000). Third, practitioners perceive their educational 
problems as extremely complex and unsolvable by research, due to the insufficiency of 
existing theories of learning, child development, and so on. Fourth, the ongoing quali¬ 
tative-quantitative methodological debate makes it difficult for school practitioners to 
decide on the best-quality evidence (Kennedy, 1997). Finally, there is a widespread and 
time-honoured tradition of privileging knowledge generated in academia over evidence 
coming from practical contexts, which deepens the gap between research and practice. 
Professional judgement based on the practitioners’ “soft” data or tacit knowledge is often 
denied a place in actionable knowledge, consequently narrowing the practitioners’ role to 
only that of a consumer of externally produced knowledge (Hammersley, 2004). 

Numerous proposals have been formulated in an attempt to bridge the gap 
between research and practice. For instance, Landry, Amara, and Lamari (2001) and Nut- 
ley, Percy-Smith, and Solesbury (2003) provide summaries of conceptual models, ranging 
from those where practitioners are consumers of research, to those where practitioners 
co-own the research process. However, most of these models have not been generated on 
the basis of empirical evidence (Hemsley-Brown & Sharp, 2003; Levin, 2011; Rickinson, 
2005). There has been little empirical data over the last few decades showing how edu¬ 
cators perceive, value, and use research in understanding what factors are important for 
research to inform teaching practice. The following section briefly summarizes empirical 
studies of the use of research by educational practitioners and factors affecting this use. 
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Use of Research by School Practitioners 

There are a few studies that report low uses of research findings by school practitioners, 
including teachers, administrators, and school professionals. Green and Kvidahl (1990) 
surveyed U.S. schoolteachers and found that respondents generally examined the research 
literature only once a year. Berube (2005) reported that six to nine out of 10 Quebec 
teachers consulted academic research between “never” and “sometimes.” Cousins and 
Walker (2000) found that Ontario schoolteachers seldom read research papers. Williams 
and Coles (2007) reported that between 60% and 80% of respondents from U.K. schools 
used research from “never” to “occasionally.” While 96% of educators that Everton, Gal- 
ton, and Pell (2000) sampled by survey had considered research findings since first quali¬ 
fying as teachers, more than a quarter of them were not able to produce a single example 
of research that had influenced their practice. 

A few studies relate how practitioners use research primarily to increase teaching 
effectiveness (McNamara, 2002), reflect on their professionalism, or experiment with 
new methods (Berube, 2005). It has also been reported that U.S. and Australian school 
principals use research to learn about effective teaching practices (Biddle & Saha, 2002; 
Saha, Biddle, & Anderson, 1995), and Everton et al. (2000) provided some evidence that 
teachers and deputy principals do the same. Their self-reports showed that engagement 
in research use, however infrequent, helped them question their current opinions, which 
led to improvements in their practice. Deputy principals expressed the highest interest in 
research, whereas teachers’ interest was the lowest. Nevertheless, it was the teachers who 
valued their personal involvement in research more than the others. 

In one respect or another, empirical studies yield a range of factors that are likely 
to affect practitioners’ use of research to inform their practice. Roger’s model of innova¬ 
tion diffusion (1995) allows the grouping of these factors along the levels of the system 
from which they emerge. Influences emerging at the individual level pertain to qualities 
of research findings as perceived by the practitioner (opinions) and the practitioner’s 
capacity to use this information for a variety of ends (expertise). At the school level, 
these factors evolve from school context and culture (organizational factors) and have an 
impact on the practitioners’ openness for learning and engagement with research gener¬ 
ated in academia or locally in school-based projects. Finally, strategies providing com¬ 
munication between the levels of the system and its actors, including practitioners and 
researchers (awareness activities), affect visibility and, consequently, the practical utility 
of research findings. 
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Opinions about Educational Research 

Opinions are the most frequently referred to and oftentimes constitute the only measure 
employed to represent research use. Practitioners’ attitudes vary from mild optimism 
about the use of research (Biddle & Saha, 2002; Cousins & Walker, 2000; Green & 
Kivdahl, 1990; Saha et al., 1995; Williams & Coles, 2007), to skepticism (Hultman & 
Horberg, 1998; Shkedi, 1998; Vanderlinde & van Braak, 2010; Zeuli & Tiezzi, 1993), 
and to outright cynicism (Nicholson-Goodman & Garman, 2007). The empirical evidence 
also highlights the qualities of research that practitioners consider mandatory for subse¬ 
quent use. These include clarity, timeliness, practical relevance, and amenability to action 
(Gore & Gitlin, 2004; Hultman & Horberg, 1998; Louis, 1996; Ratcliffe et al., 2005; 
Shkedi, 1998; Simons, Kushner, Jones, & James, 2003; Vanderlinde & van Braak, 2010). 
Teachers value research more if it matches their personal experience (Zeuli, 1994), tack¬ 
les specific aspects of teaching (Everton et al., 2000), and can be directly applied to their 
teaching (Hultman & Horberg, 1998; Ratcliffe et al., 2005; Shkedi, 1998). Evidence of 
clear school benefits is a decisive factor for school principals (Vanderlinde & van Braak, 
2010). Williams and Coles (2007) found that despite increased online access to research 
evidence, accessibility continues to be an issue. Minimal investment of time to search for 
the information and basic skills to understand and apply it to practice are the qualities that 
practitioners seek from educational research. 

Individual Expertise 

Practitioners’ research-related competencies influence the way they perceive and use 
research-based infonnation. These include the ability to formulate research questions 
about their practice, to find solutions by locating and critically appraising research, and 
to apply it in practice. Competencies are also involved in choosing between contradictory 
research information and conducting school-based research projects intended to solve 
local problems (Hultman & Horberg, 1998; Williams & Coles, 2007). Research suggests 
that practitioners’ expertise with research is associated with individual qualities and 
dispositions, such as self-efficacy (Cousins & Walker, 2000), and the commitment and 
individual willingness to innovate (Saha et al., 1995). Evidence also shows that practi¬ 
tioners’ experience with educational research increases the probability of their practical 
engagement with research. Training in research methods and participating in research 
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(Berube, 2005; Saha et al., 1995), including involvement in research projects during 
training programs and in the workplace (Cousins & Walker, 2000; Green & Kvidahl, 

1990; Lafleur, 1995), have been identified as important issues for developing research use 
skills and accumulating experience. 

Awareness Activities 

Louis (1996) argues that the ongoing dialogue between educators and researchers may 
help personalize and contextualize interventions by making research user-friendly thereby 
increasing the likelihood of its use. Sustainability of the contacts after the completion 
of a research project further encourages the use of the research (Huberman, 1990). 
Researcher-practitioner partnerships appear to enhance transfer (Berube, 2005; Ratcliffe 
et al., 2005; Simons et al., 2003). Wiliam (2002) describes the process of creating locally 
relevant knowledge where practitioners are full-fledged participants at all stages of the 
research process and become the owners of the research product. Practitioners’ direct 
involvement with the research process has also been recognized as a means of increasing 
the use of research (Cousins & Walker, 2000; Lafleur, 1995). Day, Whitaker, and John¬ 
ston (1990) report that teachers acting as researchers in school-based curriculum develop¬ 
ment projects encouraged other teachers to use results in their own practice. 

Organizational Factors 

School setting and context (Hultman & Horberg, 1998), educational norms, and profes¬ 
sional culture (Cousins & Walker, 2000; Louis, 1996; Ratcliffe et al., 2005) are factors 
that affect a school’s readiness and capacity to support individual practitioners’ learning 
efforts. For instance, schools may provide time and opportunities for teachers to read 
research and to link the understanding of research to teaching practices. A critical role 
in this process is educational leadership and administrative styles that promote organi¬ 
zational learning and change (Biddle & Saha, 2002; Cousins & Walker, 2000; Lafleur, 
1995; Ratcliffe et al., 2005; Saha et al., 1995). Embedded in a larger system, the research 
and innovation activity of a school is, in turn, affected by a number of external factors, 
including political argument, public opinion, available funding, and the presence of 
lobbyists and support groups (Wikeley, 1998). For instance, Vanderlinde and van Braak 
(2010) point out that government pressure to use specific research to change practice 
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affects adoption rates. According to Cooper (2014), research-brokering organizations, as 
intennediaries between research producers and users, are catalysts for research use by 
virtue of their capacity-building functions, implementation support, organizational devel¬ 
opment, and policy influence. 

In conclusion, it is important to note that while the rationale for school practi¬ 
tioners’ engagement in research is rather strong, the body of empirical studies reporting 
some form of outcome data on research utilization continues to be thin (e.g., Hems- 
ley-Brown & Sharp, 2003; Nutley et al., 2003; Rickinson, 2005). According to Dagenais, 
Janosz, Abrami, Bernard, and Lysenko (2012), from an extensive list of potential factors 
only some were measured for their power to detennine practitioners’ engagement with 
research. Given the lack of complete empirical data, the aim of the present study is to learn 
comprehensively which factors predict practitioners’ use of research-based information 
and the strength of the relationships between the predictors and research usage in various 
fonns. Finally, we wondered whether the use of research-based infonnation by educators 
would be higher than previously estimated because of the new emphasis on knowledge 
mobilization among researchers and the evidence-based practice among practitioners. 


Method 


Study Context 

The data presented in this study were collected as a research strand evaluating a gov¬ 
ernmental initiative put in place in Quebec, Canada, to foster the success of second¬ 
ary-school students in disadvantaged areas. Schools were expected to establish ongoing 
mechanisms for planning, implementing, and monitoring their intervention strategies 
and to improve their implementation on the basis of evaluation data and research find¬ 
ings. Indeed, research-based information was supposed to serve a three-fold purpose: 

(1) to understand and evaluate school needs; (2) to choose solutions/intervention models 
and tools that would lead to the expected impact; and (3) to enable the mechanisms and 
processes needed to implement the planned actions. Agencies supporting the initiative 
consolidated research evidence about student success, including summaries of research 
findings, tools to facilitate school action, and examples of promising practices and expe¬ 
riences. The agencies then communicated the evidence to the participating schools. 
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Monitoring data reports were also communicated systematically to implementation agents 
at all levels of the education system, including the schools, to enable them to adjust their 
actions continuously. These reports contained school evaluation data (presented as graphs 
and tables without any interpretation) on students’ reading achievement, motivation, and 
perceptions of the school environment, as well as teachers’ satisfaction with professional 
practice and their perceptions of the school environment. 

Participants 

Sixty-six secondary public schools of various sizes (small schools with fewer than 150 
students [// = 11], medium schools [n = 16], and large schools with more than 500 stu¬ 
dents [n = 39]) located in three socio-geographical zones (rural [n = 14], urban [/; = 37], 
and metropolitan [n =15]) in the Province of Quebec, Canada, were the sites for the data 
collection. Fifty-seven schools were French speaking and nine were English speaking. 

The paper questionnaires were distributed in the language of instruction to school prac¬ 
titioners, including teachers, administrators, and professionals. The latter category was 
quite broad and comprised psychoeducators, student life animators, psychologists, nurses, 
special education technicians, and so on. With 2,734 questionnaires returned anony¬ 
mously, the average participation rate was 58.7%. 

Instrument 

Instrument development 

The Questionnaire about the Use of Research-Based Information (QURBI) was developed 
to assess factors that affect the extent of research use by educational practitioners (Dage- 
nais, Janosz, Abrami, Bernard, & Lysenko, 2008). The process of questionnaire develop¬ 
ment was iterative and included five major steps. First, the available research literature 
identifying factors affecting use was used to build the initial questionnaire framework. A 
focus group of schoolteachers infonned the development process and confirmed the struc¬ 
ture of the questionnaire. Second, the authors undertook a thematic review of the available 
empirical research and survey instruments, investigating factors affecting research use. 
Third, three focus groups of teachers and professionals from urban, suburban, and rural 
English- and French-speaking schools were held to assess the relevance of the items and 
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their validity. Fourth, to reconcile all comments and suggestions stemming from the focus 
groups, an education expert from the government was invited to comment on the sections 
of the questionnaire with respect to content validity, comprehensibility, and comprehen¬ 
siveness. Finally, after the feedback had been incorporated, the revised version of the ques¬ 
tionnaire was pilot tested by 103 school practitioners from secondary schools, and further 
refined. The internal consistency reliability of the whole scale was .93. 

Study variables 

“Use of sources of research-based information” was the first set of 10 outcome variables 
and was measured on a 4-point scale from 0 (never) to 3 (five or more times). It asked 
practitioners about how frequently in the past year they had used research-based informa¬ 
tion. Research-based information (RBI) is produced by professional researchers such as 
research teams from universities (e.g., scientific publications) external evaluation teams, 
or by practitioners conducting research in collaboration with researchers (e.g., evaluations 
of school programs), produced locally and intended for local use. RBI also appears in a 
variety of sources, including scholarly documents; professional publications; evaluation 
reports; the Internet (websites); multimedia (videos and DVDs); mass media (TV, radio, 
newspapers, magazines); pre-service training; university courses; in-service training; 
workshops and professional conferences; and experts and resource staff (e.g., pedagogical 
consultants, resource teachers, librarians). 

Dimensions of use 

The second set of seven outcome variables was measured on a 4-point scale from 0 
(never) to 3 (always) and asked participants about the frequency with which they used 
RBI in the past year for a particular end. Items such as “to improve professional prac¬ 
tice,” “to develop new activities, programs,” and “to resolve problems in daily practice” 
asked about the use of research findings to change concrete practices and implied instru¬ 
mental use of RBI. The items “to achieve better understanding of practical issues,” “to 
satisfy intellectual curiosity,” and “to reflect on one’s attitudes and practices” inferred 
conceptual use, that is, changes to individual insights and ways of looking at the world. 
The item “to justify or validate decisions” measured symbolic use of RBI to confirm 
practices or actions. 


Canadian Journal of Education / Revue canadienne de l’education 37:2 (2014) 

www.cje-rce.ca 





Educational Research in Educational Practice 


10 


Potential factors in RBI use 

The 26 items were measured on a 5-point Likert scale from 1 {strongly disagree ) to 5 
{strongly agree). They were provisionally organized into four sections: (1) opinions about 
RBI pertained to relevance, timeliness, and reliability of RBI, as well as its usefulness, 
ease of access and understanding, and transferability to practice; (2) individual expertise 
addressed the importance practitioners attached to the skills needed to access, appraise, 
and translate RBI; (3) awareness activities included items about practitioners’ involve¬ 
ment in research, contact with researchers and research brokers, as well as the way 
research findings were presented to practitioners; and (4) organizational factors asked 
about school culture (supportive environment, importance of professional development, 
opportunities to challenge habits and traditions), available resources (qualified staff, 
facilities and technology, time, incentives), and external influences on individual practices 
(governmental policies, organized groups such as, unions, granting agencies, etc.). 

Practitioners’ school experience and school characteristics such as size, language 
of teaching, and socio-geographical location were controlled for as potentially related to 
practitioners’ engagement with the use of RBI. The following section describes the results 
of the major implementation of the instrument with three groups of practitioners—teach¬ 
ers, administrators, and professionals. 


Analyses 

SPSS standard procedures were applied to screen the data from 2,734 surveys. After delet¬ 
ing 302 cases where 75% and more responses were missing, the remaining missing data 
were imputed by expectation maximization. No univariate outliers were detected, whereas 
seven multivariate outliers were removed, leaving 2,425 cases for analysis. For all mea¬ 
sures, descriptive analyses were run. Analyses of variance (ANOVAs) and independent 
sample /-tests were used to compare data by groups of practitioners. Effect size coefficients 
(Cohen’s d), were calculated to identify the magnitude of dififerences/similarities between 
groups’ reports using the following formula: 

d= hz2L 

SD pooled 
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Principal component analysis with oblique rotation revealed the internal structure 
of the 26 individual variables by identifying linear combinations of these variables into 
factors. Their predictive power on the use of RBI and its dimensions was analyzed via 
hierarchical multiple regression. 

Results 

The respondents were 1,979 teachers, 125 school administrators, and 321 professionals. 
Among them, 23.6% possessed fewer than three years of experience, whereas 11.6% had 
been professionals for more than 20 years. The sample consisted of 88% French speakers 
and 12% English speakers. About 81 % (81.5%) of practitioners worked in large schools, 
14.5% worked in medium-sized schools, and 4% worked in small schools. Depending on 
the administrative area where schools were located, respondents were from city schools 
(59.5%), metropolitan schools (29.9%), and rural schools (11%). 

Use of Research-Based Information 

Table 1 summarizes the descriptive (i.e., means and standard deviations) and comparison 
statistics of teachers’, school administrators’, and practitioners’ use of RBI from differ¬ 
ent sources. Overall, the respondents positioned their use of RBI at the low end of the 
scale, between “never” and “once or twice” during the past year. Internet and mass media 
were reported as the most common outlets, whereas pre-service training was the least 
frequently used. Furthennore, the reported use of RBI remained infrequent regardless of 
whether respondents were teachers, administrators, or professionals. 

Nevertheless, multivariate and univariate tests revealed significant variations in 
groups’ self-reports about their use of RBI, implying a divide between school administra¬ 
tors, on the one hand, and teachers and professionals, on the other. School administrators 
were more likely to use traditional sources, such as scholarly documents, professional publi¬ 
cations, school evaluations, pre-service and in-service training, conferences, and the advice 
of experts. The magnitude of the differences between administrators and the other two 
groups varied from small (d = -0.25) to large id = -0.85), with the largest being -1.4 for the 
use of school evaluations. This range suggests 15% to 50% of non-overlap of the admin¬ 
istrators’ scores with those of teachers or professionals. Teachers did report higher uses of 
technology-mediated sources such as the Internet (d = 0.33) and multimedia (d = 0.44) than 
administrators, implying 23% to 29% non-overlap. 
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Table 2 summarizes practitioners’ self-reports along the dimensions of use of RBI. 
Overall, average responses fell between “sometimes” and “often.” 

Among the three groups, teachers reported the lowest use, with responses grav¬ 
itating around “sometimes,” implying sporadic use of research to inform their practice, 
whereas administrators and professionals’ reported more regular use. Differences in 
teachers’ self-reports compared with the administrators’ and professionals’ were signifi¬ 
cant. With the values of Cohen’s d ranging between 0.79 and 1.64, these differences were 
substantial, suggesting a non-overlap of 48% to 74% between the responses of teachers 
and the other two groups. 

Predictors of Use of Research-Based Information 

Table 3 summarizes school practitioners’ attitudes toward factors that may have affected 
their decision to engage in the use of RBI. Although the bulk of responses were distrib¬ 
uted around the neutral midpoint, some factors were judged to be more important. For 
instance, among the methods to communicate research findings, clear and explicit recom¬ 
mendations were given preference, whereas regular contacts with research intermediaries 
and personal involvement in research projects were least valued. The more important 
factors that respondents identified in their daily practice were supportive environment, 
availability of support staff, professional development opportunities, as well as time 
provided to practitioners to read research and apply it to solve practical issues. The less 
important factors were unions, granting agencies, and the media. Respondents valued 
research more if it was reliable and trustworthy and demonstrated potential to guide and 
improve their practice. 

On the premise that the three groups’ self-reports consistently indicated low uses 
of RBI from the range of sources, and neutral attitudes toward RBI and potential factors 
of RBI use, the planned multivariate analyses were performed for the entire sample. 

The principal component analysis of the 26 items revealed a simple four-factor 
structure accounting for 62.9% of variance, including the practitioners’ opinions about 
RBI (9.5%) and their attitudes toward awareness activities (34.6%), expertise (6.4%), and 
organizational factors (12.1%). Individual factor loadings were satisfactory and ranged 
from .58 to .84. 
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Table 3: Factors of use of research-based information by three groups of school practi¬ 
tioners (means and standard deviations, variance explained, factor loadings) 

Factor Names and Items 


Teachers 
(N= 1,979) 

Administra¬ 
tors (N = 125) 

Professionals 
(N= 321) 


Factor 

Loadings 

M(SD) 

M(SD) 

M(SD) 

Factor 1: Awareness activities (34.6% of variance explained) 

Opportunities to discuss 
research results with the 
research team 

.84 

3.61(0.91) 

3.17(0.98) 

3.16(0.96) 

Demonstrations about how 
to apply research 

.84 

3.62(0.88) 

3.30(1.01) 

3.32(1.00) 

Regular contacts with people 
who distribute research-based 
information 

.81 

3.40(0.86) 

3.09(0.94) 

3.13(0.99) 

Research results accompanied 
by clear and explicit 
recommendations 

.79 

3.93(0.79) 

3.47(0.93) 

3.50(0.91) 

Discussions of research-based 
information with colleagues 

.77 

3.72(0.83) 

3.37(0.94) 

3.31(0.98) 

Your involvement in a research 
project 

.71 

3.49(0.83) 

3.17(0.93) 

3.09(0.93) 

Presentation of research findings 
tailored to your needs 

.66 

3.63(0.77) 

3.26(0.91) 

3.36(0.86) 


Factor 2: Organizational factors (12.1% of variance explained) 


A supportive environment 

.81 

4.03(0.76) 

3.78(0.93) 

3.69(0.95) 

Human resources, such as the 
availability of qualified staff 

.80 

3.97(0.86) 

3.77(0.92) 

3.63(0.90) 

Organizational importance for 
professional development 

.78 

4.01(0.68) 

3.64(0.94) 

3.62(0.94) 

Incentives, such as 
remuneration, honoraria, 
lessening of the work-load, etc. 

.72 

3.22(1.14) 

3.63(1.07) 

3.30(1.03) 

Opportunities to challenge 
established habits and traditions 

.70 

3.76(0.76) 

3.53(0.93) 

3.42(0.89) 
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Factor Names and Items 


Teachers 
(N= 1,979) 

Administra¬ 
tors ( N = 125) 

Professionals 
(N = 321) 


Factor 

Loadings 

M(SD) 

M(SD) 

M(SD) 

Available facilities and 
technology 

.60 

3.43(.99) 

3.64(1.05) 

3.38(1.02) 

Organized groups, such as 
unions, granting agencies and 
media 

.59 

2.96(0.96) 

3.17(0.96) 

3.14(0.87) 

Available time to read a journal, 
to apply a new technique, etc. 

.58 

3.91(0.98) 

3.71(1.02) 

3.62(1.00) 


Factor 3: Opinions about research (9.5% of variance explained) 


Is relevant to your reality 

.78 

3.59(0.80) 

3.15(0.89) 

3.22(0.86) 

Offers timely information 

.77 

3.16(0.78) 

3.02(0.80) 

3.02(0.84) 

Is easy to transfer into your 
practice 

.76 

3.17(0.71) 

2.92(0.83) 

3.00(0.79) 

Is useful to guide or improve 
your professional practice 

.76 

3.88(0.70) 

3.36(0.83) 

3.40(0.88) 

Is easy to understand 

.72 

3.32(0.78) 

3.22(0.89) 

3.17(0.83) 

Is easy to find 

.69 

3.32(0.86) 

3.09(0.96) 

2.97(0.94) 

Is reliable and trustworthy 

.65 

3.72(0.76) 

3.37(0.80) 

3.36(0.79) 

Factor 4: Individual expertise (6.7% of variance explained) 

Ability to assess the quality of 
research-based information 

.84 

3.94(0.82) 

3.83(0.89) 

3.76(0.89) 

Skills to use information 
technology such as Internet, 
databases 

.80 

4.02(0.82) 

4.00(0.89) 

3.93(0.91) 

Ability to read and understand 
the research publications 

.79 

3.98(0.81) 

3.91(0.93) 

3.87(0.91) 

Expertise to translate research 
findings into practice 

.79 

3.93(0.84) 

3.83(0.89) 

3.76(0.89) 


Four sets of hierarchical multiple regressions were run to evaluate the impact of 
these four factors on the criterion variables while controlling for the effects of language 
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of instruction, school size, socio-geographical region, and amount of professional expe¬ 
rience. Because the use scores were low and not highly variable, a composite score was 
calculated to form the first criterion variable: use of RBI. Dimensions of use formed the 
second set of criterion variables where items were summed into three composites: con¬ 
ceptual, instrumental, and symbolic use. The criterion composites were modestly skewed 
(< 3) but not transformed. Pearson correlation coefficients between the composites were 
significant (p < .01), positive, and less than .56, implying that the sets measure different 
aspects of use. 

Table 4 summarizes the predictive potential of the model. In Step 1, the bivariate 
relationship between school characteristics and the four criterion variables varies from .08 
to .13, accounting for 1% or 2% of the variance. After Step 2, with both school characteris¬ 
tics and practitioners’ experience in the equation, coefficients were raised to range between 
.17 and .20, explaining from 1% to 4% of the variance in the criterion variables. With the 
addition of the four latent factors, the explanatory power increased at least sixfold. 


Table 4: Predictors of the use of research-based information and the dimensions of use: 
beta-coefficients and variance explained (hierarchical MLR) 


Predictors 


Dimensions of use 

Use of RBI - 

Conceptual Instrumental Symbolic 


Step 1 

School characteristics: 


Language 

Size 

Location 

AR 2 

H*** 

-.07** 

.03 

. 02 ** 

.06* 

-.07** 

.06* 

. 01 *** 

.05* 

-.08** 

.06* 

. 01 *** 

.03 

-.06* 

.03 

. 01 ** 

Step 2 

Practitioner’s characteristics: 

Experience 

-. 12 *** 

_ 014 *** 

^7*** 

-.14*** 

AR 2 

. 01 *** 

. 02 *** 

.03*** 

. 02 *** 

Step 3 

Practitioner’s attitudes toward: 

Awareness activities 

. 12 *** 

j 7 *** 

.15*** 

.16*** 

Organizational factors 


. 10 *** 

. 10 *** 

.09*** 

Opinions about RBI 

.27*** 

.30*** 

.30*** 

.27*** 

Individual expertise 

.23*** 

19*** 

.18*** 

'14*** 
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Predictors 

Use of RBI 


Dimensions of use 


Conceptual 

Instrumental 

Symbolic 

AR 2 

.15*** 

.16*** 

.15*** 

.12*** 

R 2 

.18 

.19 

.20 

.15 

Adjusted R 2 

.18 

.19 

.19 

.15 

R 

.43 

.44 

.44 

.39 


*p < .05; **p < .01; ***p < .001 


Among the factors, it is the practitioners’ opinions about research that contribute 
the most to explain the use of RBI and its dimensions (7% to 9%). Practitioners’ expertise 
at finding and reading, and translating it into practice accounted for 5% in RBI use and 
between 4% and 2% in its dimensions. One percent of RBI use and between 3% and 2% 
of the three dimensions were explained by the activities targeting practitioners’ awareness 
about research. Organizational factors accounted for about 1% of variance in the four 
criterion variables. 


Discussion 

Several findings were gleaned from this study with regard to the use of RBI and factors 
that bring this information to bear on educational practice. 

Practitioners’ Engagement with Research-Based Information 

The results reveal that school practitioners’ engagement with RBI was rather low and 
infrequent, even considering some of the modest variation among sources. On average, 
practitioners reported using research of any sort only once or twice in the past year. 
Overall, this discouraging finding quite closely echoes the results of a number of earlier 
studies reporting infrequent use of research by educational practitioners (Berube, 2005; 
Cousins & Walker, 2000; Green & Kvidahl, 1990; Williams & Coles, 2007). This low 
use occurred despite renewed calls for knowledge mobilization by researchers and evi¬ 
dence-based practice by educators. 
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Predictors of Use 

The four factors, including practitioners’ opinions about RBI, their attitudes toward aware¬ 
ness activities, expertise, and organizational factors, consistently but modestly explain 
the frequency of RBI use and its dimensions. Among these factors, practitioners’ attitudes 
toward research were the largest predictors of RBI use. An increase of one-standard devi¬ 
ation in practitioners’ opinions about RBI led to an increase of up to 0.30 in the predicted 
RBI use and its dimensions. Educators who shared a more positive view of RBI were likely 
to report more frequent use of research in their practice, albeit not to any great extent. 

Linked to attitudes about research is research expertise, the second most important 
detenninant of use. It includes the ability to read, understand, and assess the quality of 
research, to use information technology to access research, and to translate research into 
practice. Cousins and Walker (2000) found a significant association between self-per¬ 
ceived ability and research use by teachers, suggesting that developing practitioners’ 
capacity to appraise research evidence would help use by rendering evidence more under¬ 
standable and potentially easier to use. 

Activities that increased practitioners’ awareness of research findings were many 
and reflected the nature of the relationship between research production and use. On the 
one hand, based on the premise that research is external to the field of practice, dissemi¬ 
nation strategies encourage researchers to interest practitioners in their research outcomes 
by demonstrating the relevance of their findings to practice (Behrstock, Drill, & Miller, 
2009). On the other hand, partnerships with researchers encourage practitioners’ involve¬ 
ment in the research process. As a result of such collaborations, practitioners develop a 
sense of ownership and value in their own research (Wilson & Easton, 2003). Participants 
in this study, however, indicated their preference for the traditional model of dissemina¬ 
tion—they preferred clear and explicit recommendations to accompany research results. 

The extent to which the respondents perceived themselves as belonging to 
an organization that supported learning, especially a supportive school environment, 
emerged as a predictor of use, although it was the weakest. The preferences reported 
by practitioners echo the results of the literature, revealing a number of components 
that contribute to a school’s capacity to support the learning of its teaching staff. These 
factors refer first and foremost to leadership and administrative styles, including open¬ 
ness to change initiatives (Cousins & Walker 2000; Ratclifife et al., 2005), support for 
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collaboration and collegiality (Simons et al., 2003), providing time (Vanderlinde & van 
Braak, 2010) and appropriate resources, including technology (Hultman & Horgberg, 
1998; William & Coles, 2007), as well as prioritizing professional development (Wilson 
& Easton, 2003; Shkedi, 1998). 

In a meta-analysis of 128 studies examining factors that influence the extent to 
which attitudes shape behaviour, Glasman and Albarracin (2006) concluded that atti¬ 
tude-behaviour association was strongest when participants formed their attitude on the 
basis of behaviour-relevant infonnation. Therefore, building their knowledge of educa¬ 
tional research, supporting their involvement with research, and creating opportunities for 
direct experience could strengthen practitioners’ attitudes toward educational research. 
Indeed, teacher education, both pre- and in-service, is best positioned to support the pro¬ 
cess of attitude fonnation. Literature indicates that engagement in research-related activ¬ 
ities has an impact on practitioners’ opinions about educational research and their per¬ 
ceived ability to conduct it (Cousins & Walker, 2000; Green & Kivdahl, 1990). Although 
few participants in these studies had taken research coursework, when they did, they 
expressed more favourable attitudes toward research. Bartels (2003) argues that involv¬ 
ing pre-service teachers in systematic inquiry activities should be mandatory. Papanas- 
tasiou (2005) reports that undergraduate students’ perceived usefulness of research and 
its relevance to their professional development was highly correlated with their positive 
attitudes toward research. In Cousins and Walker’s (2000) study, the practitioners’ prior 
involvement in research increased their propensity to participate in and positively value 
school-based inquiry. 

Because little evidence exists about how teachers learn about research (Birbili, 
2002) and what effects such learning experiences have in shaping their views of them¬ 
selves as inquiring practitioners, further research needs to investigate whether pedagog¬ 
ical strategies designed to enhance teacher knowledge and skills in research are likely to 
be productive. Specifically, these should transcend the framework of formal research-re¬ 
lated courses and include practice-oriented classes, such as teacher practicums and 
courses focused on teaching methods. In addition, it is important to leam to what extent 
these attitudes, knowledge, and skills are transferrable to and sustainable in school con¬ 
texts. The extent to which the transfonnational potential of the school, including predis¬ 
positions to collaborative activities, is able to bring practitioners’ individual capacities to 
scale in order to contribute to communal action needs to be examined. Research suggests 
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that to encourage and maintain individual practitioners’ aspirations to change practice, 
the school system should be building a support capacity encompassing ongoing profes¬ 
sional-development activities explicitly grounded in research evidence; creating physical 
opportunities and stimulating intellectual needs for collegial networks to share experi¬ 
ence; and putting in place administrative and managerial controls for the time and energy 
required. Although school initiative has to play a crucial role in these processes, minis¬ 
tries of education and educational authorities should have their say in helping schools 
build the capacity structure to use RBI routinely. 

However, for these bodies to adjudicate for systemic action, the benefits of using 
RBI should be further demonstrated. Moreover, they themselves should have the will¬ 
ingness and capacity to base their decisions and actions on the best available knowledge 
rather than on opinions and preferences. 

In sum, increasing the use of research-based evidence begins with developing 
positive attitudes among educators toward the utility of research, enhancing their exper¬ 
tise to use it wisely and effortlessly, prompting their awareness of research, and creating 
an organization structure that supports evidence-based practice. Wozney, Venkatesh, and 
Abrami (2006) used expectancy theory to explain the adaptation and sustained use of 
educational technology, but it may be applicable in a wider context. First, educators must 
expect to succeed as they innovate practice—an expectation based largely on expertise. 
Second, educators must value the innovative practice in terms of its potential to improve 
teaching and learning—a value based on the attitudes of educators. And, finally, educators 
must see the costs of changing as being worth more than maintaining the status quo— 
surely a factor influenced not only by personal beliefs but also by a nurturing and approv¬ 
ing school context. 

Another aspect of cost is associated with a larger, as yet unmentioned aspect of 
evidence-based practice. What are the costs and consequences of not using evidence to 
improve practice? Where does educator wisdom need to give way to research findings? 
And, ultimately, what is the balance between the art and science of teaching? What can 
the public demand of educators and educational researchers? And what is the demand of 
the educational sciences compared to other human sciences, medical sciences, and the 
physical sciences? 
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